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Abstract.  We  improve  a  result  of  Szego  on  the  asympototic  behaviour  of 
the  trace  of  products  of  Toeplitz  matrices. 

As  an  application,  we  improve  also  his  result  on  the  limiting  behaviour  of 
the  bilinear  forms 


Bn  —  ^  ^ 


where  X,  is  a  stationary  Gaussian  sequence.  A  large  deviations  result  is  derived 
as  well. 


1.  Statement  of  Results 


A.  We  study  below  the  asymptotic  behaviour  of  bilinear  forms 


Bn  —  'y  '  at-jXtAj 
*./=i 


where  X,  is  a  mean  zero  stationary  Gaussian  sequence. 


This  problem  was  first  studied  in  the  book  of  Grenander  and  Szego,  “Toeplitz  ma¬ 
trices  and  their  applications”  (1958),  as  an  application  of  their  theory  of  the  asymptotic 
behaviour  of  the  trace  of  products  of  Toeplitz  matrices. 


Recently,  there  has  been  a  renewed  interest  in  this  problem.  See  Fox  and  Taqqu  (1983) 
and  (1986)  and  Taniguchi  (1986). 

In  Theorem  1  below  we  improve  the  results  of  Grenander  and  Szego  on  the  asymptotics 
of  the  trace  of  products  of  Toeplitz  matrices.  This  theorem  can  be  viewed  also  as  a 
generalization  of  Parseval’s  relation.  As  a  corollary  of  Theorem  1,  we  get  a  result  which 


Keyword*  and  Phrases:  Toeplitz  matrices,  trace,  singular  values,  cumulants,  large  deviations. 
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improves  Theorem  11.6  of  Grenander  and  Szego  on  the  bilinear  forms  Bn  (See  Theorem 
2)- 


The  proof  of  Theorem  1  is  based  on  a  norm  inequality  (See  Theorem  3),  communicated 
to  us  by  Professor  Larry  Brown. 

In  a  different  direction,  we  establish  a  large  deviations  result  about  Bn  (See  Theorem 

4). 

B.  Let: 

(1.2)  rn  =  EX0Xn 

denote  the  covariance  of  the  sequence  Xn.  The  key  fact  about  the  bilinear  form  Bn  is  that 
its  cumulants  are: 

(1.3)  cum k(Bn)  =  2k~1(k  -  l)'.Tr(AnRn)k. 
where  An,  Rn  are  the  n  x  n  Toeplitz  matrices: 

An{i,j)  =  a,_j,  Rn(i,j)  =  r,_;,  for  ij  =  l....,n 

(Formula  1.3)  is  an  easy  application  of  the  “diagram”  formula;  see  Rosenblatt  (19S5, 
Theorem  2.2)). 

The  first  step  in  studying  Bn  should  be  thus  the  investigation  of  the  asymptotic 
behaviour  of  the  trace  of  products  of  Toeplitz  matrices. 

Let  FnV\  J'  =  l,...,5benxn  Toeplitz  matrices  of  the  form 

=  for  t,y  =  l,...,n  and  u  =  1,...,«, 

and  suppose  are  the  Fourier  coefficients  of  the  real,  even  functions  f^(x),  i.e.: 

(1.4)  ft'  =  f 

2 


Theorem  1.  Suppose  that 


/(l/)(z)  €  Lp„,  1  <  Pw  <  oo; 


1  <  1.  tAe/J 


Jim  -7.(17  F^)  =  /"  17  (2tt/(-) (z))dj 

_ _ i  »  —  IT  _ _  * 


if  a  >  1,  and  a  >  H*  =  1(Pi/)  *,  then 


A-i 


Copy 

I'NSPE'CTCO 


Remarks:  1)  Formula  1.5  was  first  obtained  by  Grenander  and  Szezo  (1958),  7.4, 
under  the  assumption  that  f^(x)  are  bounded. 

2)  Theorem  la  is  also  a  generalization  of  the  classical  Parseval  relation.  Indeed,  it  is 
shown  in  the  Appendix  that  the  L.H.S.  of  1.5  can  also  be  written  as  the  Caesaro  sums: 


'-Tr(  n  f«) 


i/\  Ao  -*-•••  +  An_] 


where  Ak  are  the  “skew”  convolution  sums: 


Ak=  E 


v\  H - M/,  =  0 

{vi  ,...,i/.)€Dk 


J  J 

Dk  =  {{t'u  •  • .  ,vs)  :  Y,  Ui  ~~  H  Ui  -  *)• 


<i<s 

«=i 


Thus,  Theorem  la  asserts  the  Cesaro  convergence  of  the  “skew”  convolution  sums. 


BB8bb8bb»^^ 


"  '-V-VV-V.  .••‘vyv-;. 


Wf 


Note  also  that  the  “usual"  convolution  sums 


» 


) 


i 


(•) 


jf€{l, -,»}* 

J\  +  •••  4-J#  —0 

converge  to  the  R.H.S.  of  1.5,  if  /^(x)  G  LVi/ ,  X2t=i(Pv)  1  —  an^  1  <  <  oc- 

since  then  the  Fourier  sums  of  /(l^(x)  converge  in  LPi/  sense,  and  the  scalar  product  is 
continuous.  In  this  case,  taking  Cesaro  sums  is  unnecessary.  If,  however,  some  pu  equal  1 
or  oo,  and  £*  =  i(Pt/)_1  =  1 »  we  do  not  know  whether  Bn  converge  to  the  R.H.S.  of  (1.5J 
in  Cesaro  sense.  However,  for  n  =  2  and  3,  Cn  —  Dn ,  and  in  the  case  n  =  2  we  ha\e  the 
classical  Parseval  relation  (See  Katznelson,  (1968),  pg.  35). 


As  an  immediate  corollary  of  Theorem  1  we  get: 


THEOREM  2.  Let  a and  r *.  in  1.1)  and  1.2)  be  the  Fourier  coefficients  of  the  real, 
even  functions  a(x )  and  r(x),  and  suppose  a(x)  G  LPi,  r(x)  G  LP2 ,  1  <  Pi,  P2  <  00  anc^ 


(1.9) 


(Pi)  1  +  (P2)  1  —  2 


Then, 

(1.10) 

where 


Bn  E(Bn)  d  A T(n 


y/n 


N(0,o2), 


<72  =  2(27r)4  J  a2(x)r2(x)dx. 
Proof  :  Use  the  method  of  cumulants: 


/  Hn  Bn , 

cumk  ( - 7= - )  = 

v/h 


0  for  k  =  1 

2  fr(Anfinj_  for  ^  —  2 

n 

2k~l{k  -  iy.Tr^k/2'^~  for  k  >  3 


for  &  =  1 


2  •  (2tt)4  f"wa7(x)r2(x)dx  for  fc  =  2,  by  Theorem  la 

0  for  k  >  3,  By  Theorem  lb 


4 


Notes:  1)  1.10  was  first  established  by  Grenander  and  Szego  (1958,  Thm.  11.6),  under 
the  assumption  that  a(x)  and  r(x)  are  bounded. 

2)  Taqqu  and  Fox  (1983)  extended  the  result  of  Grenander  and  Szego  under  a  6et 
of  assumption  different  from  ours.  They  show  that  if  a(x)  and  r(x)  are  continuous,  ex¬ 
cept  maybe  at  0,  and  are  regularly  varying  at  0,  then  a(x)r(x)  €  L 2  (which  is  a  weaker 
assumption  than  1.9)  is  sufficient  for  1.10  to  hold. 


C.  Theorem  1  follows  from  the  following  inequality,  communicated  to  us  by  Larry 


Brown: 


Theorem  3.  For  l  <  p  <  oc, 


(1.11) 


IF^ijp  <  n1/rli/(x)|'p, 


where  Fn  l'p  =  (5Zy  =  i  l-Sy.n !r) '  F,  Sj,n  being  the  singular  values  of  the  matrix  Fn. 

(1.11)  can  be  first  established  for  p  =  2,  oc  and  1.  By  the  Riesz  convexity  theorem,  it 
follows  then  that  it  holds  for  every  p. 

D.  We  see  from  Theorem  la  that  when  a(x)  and  r(x)  are  bounded,  the  cumulants 
of  Bn  increase  all  at  the  same  asymptotic  rate  (cum^(Bn)  =  O(n)).  In  such  cases,  large 
deviations  results  hold.  We  get,  by  applying  Lemma  1  of  Cox  and  Griffeath  (1985),  the 
following: 

THEOREM  4.  Suppose  a(x )  and  r(x)  are  even,  real  functions,  which  are  Riemann 
integrable.  Let  L  =  4ir  sup  a(x)  •  sup  r(x),  and  ip(s)  =  f*r  in(l  -  47rsa(x)r(x))dx,  for 

X  X 

any  s  €  (— 00, L-1).  Then, 

a)  for  any  a  €  (^>'(0),  Hm  V>f(s)) 

lim  -Fr{—  >  a}  =  -/(a) 
n— oc  n  n 

b)  for  any  a  6  (  lim  ^>'(s), £>'(0)) 

— OO 

lim  -Pr{—  <  a}  =  -/(a), 
n— »oo  n  n 


w.  f  ,  --  - 

i»*  •  V  •  . >  >.»  »%  . 


where  1(a)  =  asa  -  ^)(sQ),  and  sa  is  the  unique  solution  of  <p'(sa)  =  a. 

2.  Proofs 

Proof  of  Theorem  1 :  a)  Let  m  be  the  number  of  which  are  non-polynomials  (have 
infinitely  many  non  zero  Fourier  coefficients).  We  will  use  induction  on  m.  For  m  =  0  (i.e. 
all  fM(x)  are  polynomials),  it  is  easy  to  check  that  (1.5)  holds.  Suppose  now  (1.5)  holds 
whenever  we  have  at  most  m  non-polynomials. 

Consider  then  any  set  of  f^(x)  which  has  at  most  m  +  1  non-polynomials,  and  suppose 
w'.l.o.g.  that  /0)(x)  is  a  non-polynomial.  Let  then  /^(x)  denote  the  fcth  Fejer  sum  of 
/^(x),  let  /0)>*(x)  =  /0)(x)  —  f£1}(x),  and  let  F^l  and  be  the  corresponding 

Toeplitz  matrices.  Then 

(2'!)  iT^Fn.i  ri  =  r  w  ri 

t/  =  2  J -ir  1/  =  2 

by  the  induction  hypothesis,  and  the  R.H.S.  of  (2.1)  converges  as  k  — ►  oc  to 
/-*•  nUi (27r/^l (x))dx  since  1  <  Pi  <  oo  implies  that  |!/*(1)  -  — +  0,  and 

ni-=2  f^Hx)  ^  i?ii  where  (pi)-1  4-  (9i)-1  <  1.  To  show  then  that  (1.5)  holds  with  up 
to  m  t  1  non-polynomials  it  remains  only  to  note  that: 


lim  lim  —\TrFj,l^’k  TT  Fi^l 

fc— »oo  n— *oo  n  11  n 

i/  =  2 

<  Jim  Ito  n /’Mil, 

fc  — oo  n— >oo  n  1 1 

v=2 

<  lim  ito  l||Fi')'*||„  ll/f’lL 

k—+oc  n  —  oo  ft  A  *- 

i/=2 

_  ]T  (p^)-1  « 

<  Jim  lim  - -  ll/(1)'*(i)||p,  I]  l!/MWlk 

fc— oo  n— oo  n 


(by  Thm  3) 


b)  Assume  first  w.l.o.g.  XI*  =  i (Pv)  1  >  1-  (Otherwise  the  result  follows  from  a)). 


6 


The  proof  is  now  similar  with  that  of  part  a).  If  all  fv'(x)  are  polynomials,  the  limit 
is  0  since  a  >  1.  Otherwise,  if  say,  /(^(x)  is  a  nonpolynomial,  replace  /O)  by  /UL*  ~  ■ 

Finally,  let  8  —  (p^)-1 '  an^  note  that 

iirr  /■(•>■*  n  fH  i  <  n 

u  =  2  i/~2 

<  FI  II^’IIp-  (since  «>1) 

^  3 

<  •n^-=»(Pl')  ||/{1)’*|!Pl  PJ  i;/(l/)ilPt  (by  Theorem  3) 

V  —  2 

8 

<  n  —  o-  ^ 

-*•  lr  — *  rv-' 


Proof  of  Theorem  4:  This  is  a  straightforward  application  of  Lemma  1  of  Cox  and 
Griffeath  (1985).  We  need  only  to  check  that  for  any  6  6  (-oc,L-1),  the  cumulant 
generating  function: 

<fn(s)  —  log  EesBn  satisfies: 


But  <£>n{s)  equals: 


1  f* 

lim  <pn(.s)  =  --  /  £n(l  ~  47rsa(i)r (x))dj 

J  —  TT 


l  n 

<Pn{s)  =  -  -  ^£n(i  -  2sAl>ri), 


where  Atjn  are  the  eigenvalues  of  An,  Rn,  for  any  s  <  [ Max  2A,in’  1  (Direct  computation). 

(2.2)  follows  now  Theorem  4.4  ii  of  Gray(l97l),  since  a(x),  r(x)  are  Riemann  in- 
tegrable,  and  the  function  £n(l  —  47rsx)  is  continuous  for  z  6  (  — oo,^p),  if  5  <  L_1. 


Note:  The  assumption  of  Riemannian  integrability  is  probably  too  strong.  We  follow 
however  Gray  in  adopting  it,  due  to  the  conceptual  simplicity  which  it  brings  to  the 
problem.  (Under  this  assumption,  the  Toeplitz  matrices  are  asymptotically  equivalent 


v.v.v  v.v.vv.v.v'y.-;. v.-  v;.-.v  -w  •-■w-ww  -,v.  .v.v 

v.v.v.  v. ^,iv.  . /V  -/  . 


with  circulars  approximands,  which  are  much  easier  to  manipulate.  This  approach  is 
nicely  illustrated  in  Gray  (1971)). 


Acknowledgement:  We  thank  Professor  Larry  Brown  for  communicating  to  us  Theo¬ 


rem  3. 


Proof  of  formula  1.7 :  Let 


Appendix 


Cn  =  {l, .  . . ,  n}®, 


let  T(j i, . . .  ,je)  denote  the  range  of  sums  Ylt=i  be. 


TV' h)  =  E*-  ~ 


Dn  =  {(ii . js)  ■  3u  =  . 3-')  ^  n)i 


and  let  An  be  the  “skew”  convolution  sums: 


*.=  EC-C 

jeo„ 


Then, 


irr(nrM)  = 


(A.l) 


-  V'  r(1)  f(2)  f(s) 

n  '  »1  -»2  '  »2-«3  '  '  ’  •'». ~*l 

*€C„ 

;  E  /r-*’  E  > 


*  1  —  *2  =7  1 

i.  -*i  =1. 


I  E  C-/r(-ry--.A)). 


j£Dn~  1 


The  last  equality  holds  since  the  set  of  all  t’s  with  given  j  differences  can  be  obtained 
from  any  of  its  elements  *^0',  by  adding  or  subtracting  (!,...,!)  as  long  as  all  components 


*  /  /  >  /  V  V  V  v  ‘  *  V  V  .  v»  -  -  /■  -  *“•  .*■  .*• 


are  in  the  range  n};  as  such,  it  has  (n  -  max  il  +  min  il  elements.  Furthermore 


-  mint'l°)  =  max(-t[°))  -  min(-t[/0') 


=  max(ij0)  -  t[,0))  -  min(? j0)  -  i^0') 

1/  1/ 

l /  V 

=  max jk)  -  min(^  jk) 

V  fc  =  l  /c=l 

=  T{ju...,je). 


Final'y,  from  (A.l)  we  get 


k  =  \j  j  €  Dk 
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